Information processing apparatus and information processing method

ABSTRACT

Contact detection units are attached to an information transfer device in a predetermined arrangement pattern to detect contact with a human body. Presentation units are attached to the information transfer device in a predetermined arrangement pattern to present a tactile stimulus. A contact detection unit that has detected contact is specified. Based on the arrangement distribution of the specified contact detection unit and a type of information to be presented via a tactile stimulus, a presentation unit to be driven is specified. The specified presentation unit is driven and controlled.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a technique of presenting a tactilestimulus to a user to notify him/her of information.

2. Description of the Related Art

CPUs having improved throughput and miniaturization of various kinds ofdevices are accelerating downsizing of general-purpose informationterminals represented by a PC and sophistication of mobile informationterminals represented by a cellular phone. Even a small single-functiondevice such as a barcode reader behaves as a simple information terminalcapable of information operation to some degree by having a high-levelinformation processing function or communication function.

Downsizing information terminals or converting small single-functiondevices into information terminals enables to widen their use range.However, since the physical size of the information transfer area issmall, information input or interpretation of output information is moredifficult than before the downsizing or conversion into informationterminals. Under these circumstances, how to input or output informationwithout difficulty using a small device has widely been examined.

When visually outputting information, as the information presentationarea becomes smaller, the visually output information is harder torecognize, and the efficiency lowers in the nature of the device. Awidely known information presentation method oriented to small devicesand, more particularly, to handheld devices tactilely presentsinformation. For example, many cellular phones present information of anincoming call or the like by vibration.

According to a technique disclosed in patent reference 1, a plurality ofoscillators are attached to a handheld device. The device presentsinformation of a direction by presenting a sense of direction based on avibration pattern of the oscillators.

[Patent reference 1] Japanese Patent Laid-Open No. 2003-199974

A technique disclosed in patent reference 2 generates a sense of torqueusing a gyroscope, thereby presenting information of the movingdirection of a handheld device.

[Patent reference 2] Japanese Patent Laid-Open No. 2005-100465

Non-patent reference 1 discloses a technique of attaching a plurality ofoscillators to the handle of a handheld device and presenting adirection to move the handle by the position of an oscillator thatvibrates.

[Non-patent reference 1] Holger Regenbrecht, et al., Virtual RealityAided Assembly with Directional Vibro-Tactile Feedback, In Proc.GRAPHITE 2005, pp. 381-387, 2005.

Non-patent reference 2 discloses a technique of presenting informationof a moving direction by a spurious tractive force generated by atemporally asymmetrical back-and-forth motion of an object.

[Non-patent reference 2] Tomohiro Amemiya, Hideyuki Ando, Taro Maeda,“Perceptual Attraction Force: Exploit the Nonlinearity of Human HapticPerception”, In Proc. of ACM SIGGRAPH 2006 Sketches, p. 40, Boston, Ma.,July 2006.

A tactile stimulus generated by the methods according to thesetechniques has been put into practical use for informationtransfer/presentation by small devices in combination with visualinformation presentation.

However, to use a tactile stimulus for information transfer (informationacquisition) in the prior arts, a body part needs to be as supposed incontact with a preset specific portion (stimulus presentation unit) forpresenting a stimulus. This may lead to a failure in correctlyoutputting information to the user depending on how he/she touches theportion.

More specifically, if the body is not in contact with the tactilestimulus presentation unit at all, no information is transferred. If thebody is in contact with only part of the stimulus presentation unit, theuser recognizes the information wrong.

There can exist a lot of patterns of user's information terminal holdingstyle depending on his/her state or an action to be executed. In theprior arts, however, it is difficult to transfer information to the userwhile flexibly coping with the various holding styles.

SUMMARY OF THE INVENTION

The present invention has been made in consideration of theabove-described problems, and provides a technique that enables toapply, for various uses, a technique of notifying a user of informationbased on a tactile stimulus.

According to the first aspect of the present invention, an informationprocessing apparatus comprising: a plurality of sensor units which areattached to the information processing apparatus in a predeterminedarrangement pattern to detect direct/indirect contact; a plurality ofpresentation units which are attached to the information processingapparatus in a predetermined arrangement pattern to present a tactilestimulus; a first specifying unit which specifies, out of said pluralityof sensor units, a sensor unit that has detected direct/indirectcontact; a second specifying unit which specifies, based on anarrangement distribution of the sensor unit specified by said firstspecifying unit and a type of information to be presented via a tactilestimulus, a presentation unit to be driven out of said plurality ofpresentation units; and a control unit which drives and controls thepresentation unit specified by said second specifying unit.

According to the second aspect of the present invention, an informationprocessing apparatus comprising: a plurality of sensor units which areattached to the information processing apparatus in a predeterminedarrangement pattern to detect direct/indirect contact; a plurality ofpresentation units which are attached to the information processingapparatus in a predetermined arrangement pattern to present a tactilestimulus; a first specifying unit which specifies, out of said pluralityof sensor units, a sensor unit that has detected direct/indirectcontact; a second specifying unit which specifies, out of said pluralityof presentation units, a presentation unit corresponding to the sensorunit specified by said first specifying unit; and a control unit whichdrives and controls the presentation unit specified by said secondspecifying unit to generate a preset stimulus pattern to expressinformation to be presented to a user.

According to the third aspect of the present invention, an informationprocessing method performed by an information processing apparatusincluding: a plurality of sensor units which are attached to theinformation processing apparatus in a predetermined arrangement patternto detect direct/indirect contact; and a plurality of presentation unitswhich are attached to the information processing apparatus in apredetermined arrangement pattern to present a tactile stimulus,comprising: a first specifying step of specifying, out of the pluralityof sensor units, a sensor unit that has detected direct/indirectcontact; a second specifying step of specifying, based on an arrangementdistribution of the sensor unit specified in the first specifying stepand a type of information to be presented via a tactile stimulus, apresentation unit to be driven out of the plurality of presentationunits; and a control step of driving and controlling the presentationunit specified in the second specifying step.

According to the fourth aspect of the present invention, an informationprocessing method performed by an information processing apparatusincluding: a plurality of sensor units which are attached to theinformation processing apparatus in a predetermined arrangement patternto detect direct/indirect contact; and a plurality of presentation unitswhich are attached to the information processing apparatus in apredetermined arrangement pattern to present a tactile stimulus,comprising: a first specifying step of specifying, out of the pluralityof sensor units, a sensor unit that has detected direct/indirectcontact; a second specifying step of specifying, out of the plurality ofpresentation units, a presentation unit corresponding to the sensor unitspecified in the first specifying step; and a control step of drivingand controlling the presentation unit specified in the second specifyingstep to generate a preset stimulus pattern to express information to bepresented to a user.

According to the fifth aspect of the present invention, an informationprocessing apparatus for transferring predetermined information via atactile stimulus, comprising: a first contact detection unit; a secondcontact detection unit; a first stimulus presentation unit; a secondstimulus presentation unit; and a stimulus device driving unit whichdrives said first stimulus presentation unit and said second stimuluspresentation unit, wherein when said first contact detection unit andsaid second contact detection unit have detected contact, said stimulusdevice driving unit drives said first stimulus presentation unit basedon a first driving pattern that expresses the predetermined informationand said second stimulus presentation unit based on a second drivingpattern that expresses the predetermined information, and when only saidfirst contact detection unit has detected contact, said stimulus devicedriving unit drives said first stimulus presentation unit based on athird driving pattern that expresses the predetermined information.

According to the sixth aspect of the present invention, an informationprocessing method performed by an information processing apparatus fortransferring predetermined information via a tactile stimulus, theinformation processing apparatus including: a first contact detectionunit; a second contact detection unit; a first stimulus presentationunit; a second stimulus presentation unit; and a stimulus device drivingunit which drives the first stimulus presentation unit and the secondstimulus presentation unit, comprising when the first contact detectionunit and the second contact detection unit have detected contact,causing the stimulus device driving unit to drive the first stimuluspresentation unit based on a first driving pattern that expresses thepredetermined information and the second stimulus presentation unitbased on a second driving pattern that expresses the predeterminedinformation, and when only the first contact detection unit has detectedcontact, causing the stimulus device driving unit to drive the firststimulus presentation unit based on a third driving pattern thatexpresses the predetermined information.

Further features of the present invention will become apparent from thefollowing description of exemplary embodiments with reference to theattached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing an example of the functionalarrangement of an information transfer device according to the firstembodiment of the present invention;

FIG. 2 is a view showing a state in which a finger that is a part of auser's body is in contact with a contact detection unit 101-x (one ofcontact detection units 101-1 to 101-M) arranged on the surface of aninformation transfer device 100;

FIG. 3 is a view showing a state in which a gloved hand 300 is incontact with the contact detection unit 101-x;

FIG. 4 is a view showing a state in which a pointing stick 400 held in ahand is in contact with the contact detection unit 101-x;

FIG. 5 is a view showing a state in which the human body is locatedwithin a predetermined range from the contact detection unit 101-x;

FIG. 6 is a view showing the information transfer device 100 having anarray of contact detection units 101-6 to 101-10 vertically arrangedalong the left side of a surface of the information transfer device 100,and an array of contact detection units 101-1 to 101-5 verticallyarranged along the right side;

FIG. 7 is a view showing a state in which a contact pattern recognitionunit 102 refers to each detection result signal and determines that thecontact detection units 101-2 to 101-5 have output detection resultsignals of levels equal to or higher than a threshold;

FIG. 8 is a flowchart of processing executed by the information transferdevice 100;

FIG. 9 is a view showing an example of the outer appearance of astationary device 900 which is installed on a floor or a table and canbe operated by a user who touches its surface;

FIG. 10 is a block diagram showing an example of the functionalarrangement of an information transfer device 1000;

FIG. 11 is a view showing an example of the outer appearance of theinformation transfer device 1000;

FIG. 12 is a view showing a state in which the user's right hand gripsthe right side of the information transfer device 1000, and the lefthand grips the left side;

FIG. 13 is a view showing an example of the waveforms of a first drivingpattern and a second driving pattern

FIG. 14 is a view showing a state in which the user's right hand gripsthe right side of the information transfer device 1000;

FIG. 15 is a view showing an example of the waveform of a third drivingpattern;

FIG. 16 is a flowchart of processing executed by the informationtransfer device 1000;

FIG. 17 is a block diagram showing an example of the functionalarrangement of an information transfer device 1700 according to thethird embodiment of the present invention;

FIG. 18 is a view showing an example of the outer appearance of theinformation transfer device 1700;

FIG. 19 is a view showing a state in which the user's right hand gripsthe right side of the information transfer device 1700, and the lefthand grips the left side;

FIG. 20 is a view showing a state in which the user's right hand gripsthe right side of the information transfer device 1700;

FIG. 21 is a flowchart of processing executed by the informationtransfer device 1700;

FIG. 22 is a block diagram showing an example of the functionalarrangement of an information transfer device 2200 according to thefourth embodiment of the present invention;

FIG. 23 is a view showing an example of the outer appearance of theinformation transfer device 2200;

FIG. 24 is a flowchart of processing executed by the informationtransfer device 2200;

FIG. 25 is a block diagram showing an example of the functionalarrangement of an information transfer device 2500; and

FIG. 26 is a flowchart of processing executed by the informationtransfer device 2500.

DESCRIPTION OF THE EMBODIMENTS

The embodiments of the present invention will now be described in detailwith reference to the accompanying drawings. Note that the embodimentswill be explained here as mere examples of the arrangement of thepresent invention defined in the appended claims, and the presentinvention is not limited to the individual embodiments to be describedbelow.

First Embodiment

An information processing apparatus according to this embodiment is aninformation transfer device which is gripped and operated by a user, andhas a function of presenting information to the user based on a tactilestimulus. This information transfer device is, for example, a digitalcamera or an ultrasonic probe a user can hold in hands and operate.Using a tactile stimulus, the device notifies the user of, e.g.,operation navigation information representing how to move theinformation transfer device, a processing result output from theinformation transfer device in response to a user input, and informationof some kind the information transfer device has externally acquired bymeasurement or communication.

The information transfer device will be described below in more detail.

<Arrangement of Information Transfer Device>

FIG. 1 is a block diagram showing an example of the functionalarrangement of an information transfer device according to thisembodiment. As shown in FIG. 1, an information transfer device 100according to this embodiment includes a plurality of contact detectionunits 101-1 to 101-M, a plurality of stimulus presentation units 104-1to 104-N, a contact pattern recognition unit 102, and a stimulus patterngeneration unit 103.

The plurality of contact detection units 101-1 to 101-M are arranged onor inside the information transfer device 100 in a predeterminedarrangement pattern. Each of the plurality of contact detection units101-1 to 101-M detects direct/indirect contact with the user and outputsthe detection result (a signal value representing presence/absence ofdirect/indirect contact) to the contact pattern recognition unit 102.Each of the plurality of contact detection units 101-1 to 101-M isformed from, e.g., a sensor unit such as a capacitor sensor, an opticalsensor, a pressure sensor, or a strain sensor. When the output valuefrom the sensor unit exceeds a predetermined threshold, the contactpattern recognition unit 102 detects the presence of contact. Note thatthe contact detection units 101-1 to 101-M may not only output thedetection result of the presence/absence of contact but also detect adegree of contact (e.g., a pressure or a contact area) and output thedetection result to the contact pattern recognition unit 102.

FIG. 2 is a view showing a state in which a finger that is a part of auser's body is in contact with a contact detection unit 101-x (one ofthe contact detection units 101-1 to 101-M) arranged on the surface ofthe information transfer device 100. FIG. 2 illustrates only one of theplurality of contact detection units 101-1 to 101-M. However, the humanbody need not always be in direct contact with the contact detectionunit 101-x, as shown in FIG. 2.

For example, even when a gloved hand 300 or a pointing stick 400 comesinto contact with the contact detection unit 101-x, as shown in FIGS. 3and 4, the contact detection unit 101-x may output a signal representing“presence of contact with the human body” to the contact patternrecognition unit 102.

Even when the human body is located within a predetermined range fromthe contact detection unit 101-x, as shown in FIG. 5, the contactdetection unit 101-x may output a signal representing “presence ofcontact with the human body” (presence of indirect contact with theuser) to the contact pattern recognition unit 102.

For example, if the contact detection unit is formed from a capacitorsensor, its output value changes not only when the human body is incontact with the capacitor sensor but also when the human body islocated near the capacitor sensor. Using, as a threshold, the valueoutput from the capacitor when the human body is located within apredetermined range from the capacitor sensor, a situation in which thehuman body is located within a predetermined range from the capacitorsensor can be detected as “presence of contact with the human body”. Inthe device that detects, as “presence of contact”, the situation inwhich the human body is located within a predetermined range from thecontact detection unit, when a body part comes into direct contact withone contact detection unit, another contact detection unit locatedwithin a predetermined range from it also detects the contact. In thiscase, direct contact and indirect contact are detected either asidentical “contacts” or distinctively.

In this embodiment, any kind of sensor unit is usable as long as it candetect direct/indirect contact with a user or a physical object.

The contact pattern recognition unit 102 receives detection resultsignals periodically transmitted from the contact detection units 101-1to 101-M and checks the level of each detection result signal. In thischeck, it is checked whether the level of each received detection resultsignal is equal to or higher than a threshold. As a result of the check,the contact pattern recognition unit 102 obtains a contact pattern whichis information to specify (first specification) a contact detection unitthat has output a detection result signal of level equal to or higherthan the threshold (detection result signal representing presence ofcontact). In other words, the contact pattern represents a pattern ofhuman body contact with the information transfer device 100. Note that adefinition in broader sense such as a contact presence/absencedistribution (the arrangement distribution of contact detection unitsthat have detected contact) or a contact pressure distributionindicating the strength of contact in each space may be given as thecontact pattern. Alternatively, the contact pattern may be “the shapeand position/orientation of the human body in contact with theinformation transfer device 100”, which is estimated from a spatialdistribution concerning the contact.

An example of the operation of the contact pattern recognition unit 102will be explained here with reference to FIG. 6. FIG. 6 is a viewshowing the information transfer device 100 having the array of contactdetection units 101-6 to 101-10 vertically arranged along the left sideof a surface of the information transfer device 100, and the array ofcontact detection units 101-1 to 101-5 vertically arranged along theright side. Each of the contact detection units 101-1 to 101-10transmits a detection result signal representing presence/absence ofcontact to the contact pattern recognition unit 102, as described above.Assume that the contact pattern recognition unit 102 refers to eachdetection result signal and determines that only the contact detectionunit 101-2 has output a detection result signal of level equal to orhigher than the threshold. In this case, the contact pattern recognitionunit 102 recognizes that a human body 600 (e.g., finger) is reached fromthe outside of the information transfer device 100 toward the contactdetection unit 101-2. In this case, the contact pattern recognition unit102 generates information (contact pattern) representing that only thecontact detection unit 101-2 detects the contact.

Assume that the contact pattern recognition unit 102 refers to eachdetection result signal and determines that the contact detection units101-2 to 101-5 have output detection result signals of levels equal toor higher than the threshold, as shown in FIG. 7. In this case, thecontact pattern recognition unit 102 recognizes that a human body 700(finger) is reached along the array of the contact detection units 101-2to 101-5. In this case, the contact pattern recognition unit 102generates information (contact pattern) representing that only thecontact detection units 101-2 to 101-5 detect the contact.

In this way, the contact pattern recognition unit 102 outputs, to thestimulus pattern generation unit 103, the contact pattern which isinformation to specify a contact detection unit that has output adetection result signal of level equal to or higher than the threshold.

The stimulus pattern generation unit 103 receives the contact patternoutput from the contact pattern recognition unit 102 and generates astimulus pattern corresponding to the contact pattern. Based on thegenerated stimulus pattern, the stimulus pattern generation unit 103outputs driving control signals to drive and control some or all of thestimulus presentation units 104-1 to 104-N to corresponding stimuluspresentation units.

The stimulus pattern is a distribution of points that produce stimuli ora distribution indicating the intensity, quality, or time-rate changepattern of a stimulus in each space. “Information” to be presented tothe user based on the stimulus pattern is, e.g., direction informationsuch as “right” or status information such as “mail incoming”. Stimuluspattern generation is determined based on the contact pattern receivedfrom the contact pattern recognition unit 102 and the type ofinformation to be presented to the user.

More specifically, the stimulus pattern generation unit 103 specifies,based on the received contact pattern, contact detection units that havedetected contact. Based on the arrangement distribution of the specifiedcontact detection units, the stimulus pattern generation unit 103specifies, out of the stimulus presentation units 104-1 to 104-N, a setof stimulus presentation units which should be in contact with theuser's body (second specification). This specification processing isperformed based on the positional relationship between the contactdetection units 101-1 to 101-M and the stimulus presentation units 104-1to 104-N. Assume that each contact detection unit and a stimuluspresentation unit adjacent to it make a pair. In this case, a stimuluspresentation unit paired with a contact detection unit that has detectedcontact is determined to be in contact with the human body. Next, topresent information using the stimulus presentation unit determined tobe in contact with the human body, the stimulus pattern generation unit103 generates a stimulus pattern representing the operation rule of thestimulus presentation unit. For example, to notify the user of directioninformation “right”, the stimulus pattern generation unit 103 generatesa preset stimulus pattern to drive only the stimulus presentation unitslocated relatively on the right side out of the stimulus presentationunit group determined to be in contact with the human body. Note that“contact with the human body” may also indicate that a stimuluspresentation unit is not in direct contact with the human body but islocated within a predetermined range from it. To determine whether astimulus presentation unit is located “relatively on the right side”,the stimulus pattern generation unit 103 may have an orientation sensor(not shown).

Based on the arrangement distribution of the contact detection unitswhich have detected direct/indirect contact with the user and the typeof information to be presented to the user, the stimulus patterngeneration unit 103 thus specifies units to be driven out of thestimulus presentation units 104-1 to 104-N. Then, the stimulus patterngeneration unit 103 generates a pattern to stimuli to be produced by thespecified stimulus presentation units.

After stimulus pattern generation, the stimulus pattern generation unit103 outputs a driving control signal based on the generated stimuluspattern to each driving target stimulus presentation unit. The drivingcontrol signal can designate either only ON/OFF of driving or theintensity or time-rate change of a stimulus to be presented by driving.

The stimulus presentation units 104-1 to 104-N are arranged on or insidethe information transfer device 100 in a predetermined arrangementpattern. Each of the stimulus presentation units 104-1 to 104-N receivesa driving control signal from the stimulus pattern generation unit 103and operates (produces a stimulus) based on the received driving controlsignal. In this case, the stimulus is a tactile stimulus which isperceived when the human body is in direct contact with the stimuluspresentation unit or in contact with the vicinity of it, or has entereda predetermined range via clothes or the like (when the human body is inindirect contact with the stimulus presentation unit). Each of thestimulus presentation units 104-1 to 104-N is formed from, e.g., anoscillator, a voice coil, or a small pin array. If the driving controlsignal designates only ON/OFF of driving, the stimulus presentation unitthat has received the driving control signal is driven to produce astimulus having a predetermined intensity. If the driving control signalalso designates a stimulus intensity, the stimulus presentation unit isdriven to produce a stimulus at that intensity. If the driving controlsignal also designates a time-rate change, the stimulus presentationunit is driven to produce a stimulus that changes as designated.

<Operation of Information Transfer Device 100>

FIG. 8 is a flowchart of processing executed by the information transferdevice 100.

First, in step S801, the contact pattern recognition unit 102 acquires adetection result signal transmitted from each of the contact detectionunits 101-1 to 101-M and representing presence/absence of contact or acontact strength.

In step S802, based on the detection result signal group acquired instep S801, the contact pattern recognition unit 102 recognizes the humanbody contact pattern on the information transfer device 100. The contactpattern recognition unit 102 outputs, to the stimulus pattern generationunit 103, data representing the thus recognized contact pattern.

In step S803, based on the contact pattern output from the contactpattern recognition unit 102, the stimulus pattern generation unit 103specifies, out of the stimulus presentation units 104-1 to 104-N, a setof stimulus presentation units which should be in contact with theuser's body.

In step S804, the stimulus pattern generation unit 103 generates astimulus pattern to specify, out of the stimulus presentation unitscontained in the set specified in step S803, stimulus presentation unitsto be used to present notification information.

In step S805, the stimulus pattern generation unit 103 outputs acorresponding driving control signal to each stimulus presentation unitspecified by the generated stimulus pattern. Each of the stimuluspresentation units 104-1 to 104-N operates (produces a stimulus) basedon the driving control signal received from the stimulus patterngeneration unit 103.

The process then returns to step S801 to repeat the subsequentprocesses.

With the above-described processing, the information transfer device 100recognizes the user's way of gripping the information transfer device100 and, based on the recognition result, causes a portion that isreliably in contact with the user to produce a stimulus. This makes itpossible to correctly present, to the user, information to be presented.

<Modification>

In the above description, the information transfer device 100 is grippedby the user. However, the first embodiment is not always limited to thegripped type. For example, a stationary device 900 installed on a flooror a table can be operated by a user who touches its surface, as shownin FIG. 9, may be used as the information transfer device 100.

Second Embodiment

<Arrangement of Information Transfer Device 1000>

FIG. 10 is a block diagram showing an example of the functionalarrangement of the information transfer device 1000. As shown in FIG.10, the information transfer device 1000 includes contact detectionunits 1001 and 1002, stimulus presentation units 1003 and 1004, and astimulus device driving unit 1005.

The contact detection units 1001 and 1002 perform the same operation asthat of the contact detection units 101-1 to 101-M and are arranged onor inside the information transfer device 1000 in a predeterminedarrangement pattern. Each of the contact detection units 1001 and 1002(first and second contact detection units) outputs a signal representinga detection result to the stimulus device driving unit 1005.

The stimulus presentation unit 1003 is the same as each of the stimuluspresentation units 104-1 to 104-N described in the first embodiment. Thestimulus presentation unit 1003 is arranged on or inside the informationtransfer device 1000 and, more particularly, near the contact detectionunit 1001. The stimulus presentation unit 1004 is the same as each ofthe stimulus presentation units 104-1 to 104-N described in the firstembodiment. The stimulus presentation unit 1004 is arranged on or insidethe information transfer device 1000 and, more particularly, near thecontact detection unit 1002. Each of the stimulus presentation units1003 and 1004 (first and second stimulus presentation units) receives adriving control signal from the stimulus device driving unit 1005 andoperates (produces a stimulus) based on the received driving controlsignal. In this case, the stimulus is a tactile stimulus which isperceived when the human body is in direct contact with the stimuluspresentation unit or in contact with the vicinity of it, or has entereda predetermined range via clothes or the like (when the human body is inindirect contact with the stimulus presentation unit).

FIG. 11 is a view showing an example of the outer appearance of theinformation transfer device 1000. As shown in FIG. 11, the contactdetection units 1001 and 1002 and the stimulus presentation units 1003and 1004 are arranged on a surface of the information transfer device1000. The contact detection unit 1001 and the stimulus presentation unit1003 are arranged adjacent on the right side of the surface. The contactdetection unit 1002 and the stimulus presentation unit 1004 are arrangedadjacent on the left side of the surface.

In accordance with detection result signals received from the contactdetection units 1001 and 1002, the stimulus device driving unit 1005generates stimulus patterns to drive and control the stimuluspresentation units 1003 and 1004. More specifically, the stimulus devicedriving unit 1005 refers to a signal received from the contact detectionunit 1001. If the signal represents presence of direct/indirect contactwith a human body or a physical object, the stimulus device driving unit1005 outputs a driving control signal representing a first drivingpattern to the stimulus presentation unit 1003. Similarly, the stimulusdevice driving unit 1005 refers to a signal received from the contactdetection unit 1002. If the signal represents presence ofdirect/indirect contact with a human body or a physical object, thestimulus device driving unit 1005 outputs a driving control signalrepresenting a second driving pattern to the stimulus presentation unit1004. Each driving pattern expresses transfer information by combiningstimuli produced based on it.

The operation of the information transfer device 1000 when transferringdirection information “from the right to the left” to the user will beexplained. The essence of the following description is almost the sameeven for transfer information of other type. Assume that the user'sright hand grips the right side of the information transfer device 1000,and the left hand grips the left side, as shown in FIG. 12. The stimulusdevice driving unit 1005 receives signals representing presence ofcontact from both the contact detection units 1001 and 1002. At thistime, the stimulus device driving unit 1005 outputs signals havingwaveforms shown in FIG. 13 to the stimulus presentation units 1003 and1004 as the driving control signal representing the first drivingpattern and that representing the second driving pattern, respectively.Referring to FIG. 13, time is plotted along the abscissa, and thedriving intensity (stimulus intensity) is plotted along the ordinate.

The stimulus presentation unit 1003 is driven first, and the stimuluspresentation unit 1004 is driven next. Since the contact detection unit1001 detects the contact with the right hand, the stimulus presentationunit 1003 arranged near the contact detection unit 1001 is also supposedto be in contact with the right hand. Hence, the stimulus presentationunit 1003 which is driven first presents a stimulus to the right hand.Similarly, since the contact detection unit 1002 detects the contactwith the left hand, the stimulus presentation unit 1004 arranged nearthe contact detection unit 1002 is also supposed to be in contact withthe left hand. Hence, the stimulus presentation unit 1004 which isdriven subsequently presents a stimulus to the left hand.

In this way, the stimulus is presented first to the right hand and thento the left hand after a predetermined time lag. The informationtransfer device 1000 thus transfers the direction information “from theright to the left” to the user.

Assume that the stimulus device driving unit 1005 receives a signalrepresenting presence of contact from the contact detection unit 1001and a signal representing absence of contact from the contact detectionunit 1002. In this case, the stimulus device driving unit 1005 outputs adriving control signal representing a third driving pattern to thestimulus presentation unit 1003. The third driving pattern expressespredetermined information via a stimulus produced upon driving. Thepredetermined information is information fixed in advance or informationreceived from an external information processing unit (not shown).

A case in which direction information “from the right to the left” istransferred to the user will be explained again. Assume that the user'sright hand grips the right side of the information transfer device 1000,as shown in FIG. 14. The stimulus device driving unit 1005 receives asignal representing presence of contact from the contact detection unit1001 and a signal representing absence of contact from the contactdetection unit 1002. At this time, the stimulus device driving unit 1005outputs a signal having a waveform shown in FIG. 15 to the stimuluspresentation unit 1003 as the driving control signal representing thethird driving pattern. Referring to FIG. 15, time is plotted along theabscissa, and the driving intensity (stimulus intensity) is plottedalong the ordinate.

The stimulus presentation unit 1003 is driven first long and then short.Since the contact detection unit 1001 detects the contact with the righthand, the stimulus presentation unit 1003 arranged near the contactdetection unit 1001 is also supposed to be in contact with the righthand. Hence, the stimulus presentation unit 1003 is driven to present astimulus to the right hand. The first long driving of the stimuluspresentation unit 1003 presents a temporally long stimulus to the righthand. Subsequently, the short driving of the stimulus presentation unit1003 presents a temporally short stimulus to the right hand. Theinformation transfer device 1000 thus transfers the directioninformation “from the right to the left” to the user.

Note that to transfer direction information “from the left to the right”to the user, the stimulus device driving unit 1005 outputs, to thestimulus presentation unit 1003, a driving control signal representing apattern opposite to the third pattern shown in FIG. 15. The first shortdriving of the stimulus presentation unit 1003 presents a temporallyshort stimulus to the right hand. Next, the long driving of the stimuluspresentation unit 1003 presents a temporally long stimulus to the righthand. The information transfer device 1000 thus transfers the directioninformation “from the left to the right” to the user.

The user can know in advance or afterward the combination of thetransfer information and the stimulus pattern to express it. It can benotified the user of a direction to be presented and a correspondingstimulus pattern in advance. The combination of the transfer informationand the stimulus pattern to express it is not limited to theabove-described example. The combination may be held by the stimulusdevice driving unit 1005 in advance as a table. Alternatively, everytime transfer information is known, the stimulus device driving unit1005 may produce a stimulus.

Note that in the example shown in FIG. 14, since the contact detectionunit 1002 outputs no signal representing “presence of contact”, thestimulus presentation unit 1004 is also supposed to have no contact. Atthis time, it is impossible to make the user tactilely perceive astimulus representing transfer information by driving the stimuluspresentation unit 1004. The stimulus device driving unit 1005 mayinstead output a driving control signal representing “driving OFF” tothe stimulus presentation unit 1004 simultaneously with outputting thedriving control signal representing the third driving pattern to thestimulus presentation unit 1003.

In this case, since the stimulus presentation unit 1004 is not driven,power consumed by the information transfer device 1000 can be saved.However, the stimulus device driving unit 1005 may output the drivingcontrol signal representing the third driving pattern to the stimuluspresentation unit 1003 and simultaneously the driving control signalrepresenting the third driving pattern to the stimulus presentation unit1004 as well. Driving of the stimulus presentation unit 1004 can give astimulus to the user not perceptually but visually (for example, theuser can visually confirm the vibration). Hence, the stimuluspresentation unit 1004 can be driven to visually assist perception ofthe tactile stimulus produced by the stimulus presentation unit 1003.

Assume that the stimulus device driving unit 1005 receives a signalrepresenting absence of contact from the contact detection unit 1001 anda signal representing presence of contact from the contact detectionunit 1002. At this time, the stimulus device driving unit 1005 outputsthe driving control signal representing the third driving pattern to thestimulus presentation unit 1004. For example, to transfer directioninformation “from the right to the left” to the user, the stimulusdevice driving unit 1005 drives the stimulus presentation unit 1004first short and then long. Since the contact detection unit 1002 detectsthe contact with the left hand, the stimulus presentation unit 1004arranged near the contact detection unit 1002 is also supposed to be incontact with the left hand. Hence, the stimulus presentation unit 1004is driven to present a stimulus to the left hand. The first shortdriving of the stimulus presentation unit 1004 presents a temporallyshort stimulus to the left hand. Subsequently, the long driving of thestimulus presentation unit 1004 presents a temporally long stimulus tothe left hand. The information transfer device 1000 thus transfers thedirection information “from the right to the left” to the user.Reversely, to transfer direction information “from the left to theright” to the user, the stimulus device driving unit 1005 drives thestimulus presentation unit 1004 first long and then short. The firstlong driving of the stimulus presentation unit 1004 presents atemporally long stimulus to the left hand. Next, the short driving ofthe stimulus presentation unit 1004 presents a temporally short stimulusto the left hand. The information transfer device 1000 thus transfersthe direction information “from the left to the right” to the user.

<Operation of Information Transfer Device 1000>

FIG. 16 is a flowchart of processing executed by the informationtransfer device 1000.

First, in step S1601, the stimulus device driving unit 1005 acquires adetection result signal transmitted from each of the contact detectionunits 1001 and 1002 and representing presence/absence of contact or acontact strength.

In step S1602, the stimulus device driving unit 1005 refers to eachdetection result signal acquired in step S1601. The stimulus devicedriving unit 1005 determines whether each detection result signalrepresents presence of contact or absence of contact. This determinationis the same as in the first embodiment.

The processing branches based on the determination result.

When the stimulus device driving unit 1005 receives signals representingpresence of contact from both the contact detection units 1001 and 1002,the process advances to step S1603. When the stimulus device drivingunit 1005 receives a signal representing presence of contact from thecontact detection unit 1001 and a signal representing absence of contactfrom the contact detection unit 1002, the process advances to stepS1604. When the stimulus device driving unit 1005 receives a signalrepresenting absence of contact from the contact detection unit 1001 anda signal representing presence of contact from the contact detectionunit 1002, the process advances to step S1605. When the stimulus devicedriving unit 1005 receives signals representing absence of contact fromboth the contact detection units 1001 and 1002, the process returns tostep S1601.

In step S1603, the stimulus device driving unit 1005 outputs signalshaving the waveforms shown in FIG. 13 to the stimulus presentation units1003 and 1004 as the driving control signal representing the firstdriving pattern and that representing the second driving pattern,respectively. The stimulus presentation units 1003 and 1004 are drivenbased on the received driving control signals, respectively. The processthen returns to step S1601.

In step S1604, the stimulus device driving unit 1005 outputs the drivingcontrol signal representing the third driving pattern to the stimuluspresentation unit 1003. The stimulus presentation unit 1003 is drivenbased on the received driving control signal. The process then returnsto step S1601.

In step S1605, the stimulus device driving unit 1005 outputs the drivingcontrol signal representing the third driving pattern to the stimuluspresentation unit 1004. The stimulus presentation unit 1004 is drivenbased on the received driving control signal. The process then returnsto step S1601. Note that the third driving pattern in step S1605 isdifferent from that in step S1604, as described above. However, thetransfer information expressed by the third driving pattern in stepS1605 is the same as that expressed by the third driving pattern in stepS1604.

By repeating the above-described processing, the information transferdevice 1000 can recognize the contact state of the user on it and notifythe user of transfer information via a tactile stimulus in accordancewith the contact state.

Third Embodiment

An information transfer device according to this embodiment transfersinformation to a user via a tactile stimulus, as in the secondembodiment. In the information transfer device of this embodiment, eachof the stimulus presentation units 1003 and 1004 described in the secondembodiment further includes a plurality of stimulus presentation units(sub-stimulus presentation units). That is, including a plurality ofstimulus presentation units into, e.g., the stimulus presentation unit1003 enables finer (more correct) information presentation.

<Arrangement of Information Transfer Device 1700>

FIG. 17 is a block diagram showing an example of the functionalarrangement of the information transfer device 1700 according to thisembodiment. As shown in FIG. 17, the information transfer device 1700includes contact detection units 1701 and 1702, stimulus presentationunits 1703-1 to 1703-N, and a stimulus device driving unit 1705.

The contact detection units 1701 and 1702 are the same as the contactdetection units 1001 and 1002 described in the second embodiment and arearranged on or inside the information transfer device 1700 in apredetermined arrangement pattern. Each of the contact detection units1701 and 1702 outputs a signal representing a detection result to thestimulus device driving unit 1705.

Each of the stimulus presentation units 1703-1 to 1703-N is arranged onor inside the information transfer device 1700. Each of the stimuluspresentation units 1703-1 to 1703-M (2<M<N) is the same as the stimuluspresentation unit 1003 described in the second embodiment and isarranged near the contact detection unit 1701. Each of the stimuluspresentation units 1703-(M+1) to 1703-N is the same as the stimuluspresentation unit 1004 described in the second embodiment and isarranged near the contact detection unit 1702. That is, the stimuluspresentation units 1703-1 to 1703-N are divided into two groups, i.e.,the group of the stimulus presentation units 1703-1 to 1703-M and thegroup of the stimulus presentation units 1703-(M+1) to 1703-N. Thenumber of divided groups need not always be two depending on the numberof contact detection units or the arrangement form of the stimuluspresentation units.

FIG. 18 is a view showing an example of the outer appearance of theinformation transfer device 1700. As shown in FIG. 18, the array of thestimulus presentation units 1703-(M+1) to 1703-N is vertically arrangedalong the left side of a surface of the information transfer device1700. The contact detection unit 1702 is arranged near them. On theother hand, the array of the stimulus presentation units 1703-1 to1703-M is vertically arranged along the right side of the surface of theinformation transfer device 1700. The contact detection unit 1701 isarranged near them.

Based on detection result signals received from the contact detectionunits 1701 and 1702, the stimulus device driving unit 1705 supplies adriving pattern to each of the stimulus presentation units 1703-1 to1703-N. The driving pattern represents the ON/OFF pattern of driving orthe time-rate change pattern of intensity.

Assume that the user's right hand grips the right side of theinformation transfer device 1700, and the left hand grips the left side,as shown in FIG. 19. The stimulus device driving unit 1705 receivesdetection result signals representing presence of contact from both thecontact detection units 1701 and 1702. In this case, the user can besupposed to hold the entire information transfer device 1700 by bothhands. Hence, the stimulus device driving unit 1705 estimates that thetip of the user's right thumb is in contact with one of the stimuluspresentation units 1703-1 to 1703-M. The stimulus device driving unit1705 also estimates that the tip of the user's left thumb is in contactwith one of the stimulus presentation units 1703-(M+1) to 1703-N. Thatis, the stimulus device driving unit 1705 estimates the contact statebetween the human body and a larger number of stimulus presentationunits based on the contact detection results from the contact detectionunits fewer than the stimulus presentation units. The stimulus devicedriving unit 1705 outputs driving control signals representing a firstdriving pattern to the stimulus presentation units 1703-1 to 1703-M anddriving control signals representing a second driving pattern to thestimulus presentation units 1703-(M+1) to 1703-N.

Each driving pattern expresses transfer information by combining stimuliproduced upon driving. Since the plurality of stimulus presentationunits present identical stimuli, the user perceives a tactile stimulusexpressing transfer information if one of them is in contact withhis/her body.

Assume that the user's right hand grips the right side of theinformation transfer device 1700, as shown in FIG. 20. The stimulusdevice driving unit 1705 receives a detection result signal representingpresence of contact from the contact detection unit 1701 and a detectionresult signal representing absence of contact from the contact detectionunit 1702. In this case, the user can be supposed to hold the entireinformation transfer device 1700 by only the right hand. Hence, thestimulus device driving unit 1705 estimates that the user's right thumbfrom its tip to the base is in contact with one of the stimuluspresentation units 1703-1 to 1703-M.

For transfer information “downward from the upper side”, the stimulusdevice driving unit 1705 outputs, to the stimulus presentation units1703-1 to 1703-M, driving control signals representing a driving patternto cause the stimulus presentation units 1703-1 to 1703-M tosequentially produce stimuli. If the supposition is correct, the user'sthumb is stimulated from its tip to the base sequentially from the upperside, thereby notifying the user of the transfer information “downwardfrom the upper side”. For transfer information “from the right to theleft”, the stimulus device driving unit 1705 outputs driving controlsignals representing a stimulus pattern to cause the stimuluspresentation units 1703-1 to 1703-M to simultaneously produce stimulifirst long and then short. If the supposition is correct, the wholeuser's right thumb perceives tactile stimuli first long and then shortand thus receives the transfer information “from the right to the left”.

As described in these examples, providing a plurality of stimuluspresentation units to create a situation where more stimuluspresentation units come into contact with the body brings about anadvantage in increasing the types of information expression methodscorresponding to the ways of contact.

The relationship between the contact detection results of the contactdetection units 1701 and 1702, the transfer information, and the drivingpatterns of the stimulus presentation units 1703-1 to 1703-N is notlimited to the above-described examples. The relationship may be held bythe stimulus device driving unit 1705 in advance as a table.Alternatively, every time a contact detection result is obtained, thestimulus device driving unit 1705 may estimate the contact state betweenthe user and the plurality of stimulus presentation units and generate,based on the estimation result, a driving pattern corresponding totransfer information.

<Operation of Information Transfer Device 1700>

FIG. 21 is a flowchart of processing executed by the informationtransfer device 1700.

First, in step S2101, the stimulus device driving unit 1705 acquires adetection result signal transmitted from each of the contact detectionunits 1701 and 1702 and representing presence/absence of contact or acontact strength.

In step S2102, the stimulus device driving unit 1705 refers to eachdetection result signal acquired in step S2101. The stimulus devicedriving unit 1705 determines whether each detection result signalrepresents presence of contact or absence of contact. This determinationis the same as in the first embodiment.

The processing branches based on the determination result.

When the stimulus device driving unit 1705 receives signals representingpresence of contact from both the contact detection units 1701 and 1702,the process advances to step S2103. When the stimulus device drivingunit 1705 receives a signal representing presence of contact from thecontact detection unit 1701 and a signal representing absence of contactfrom the contact detection unit 1702, the process advances to stepS2104. When the stimulus device driving unit 1705 receives a signalrepresenting absence of contact from the contact detection unit 1701 anda signal representing presence of contact from the contact detectionunit 1702, the process advances to step S2105. When the stimulus devicedriving unit 1705 receives signals representing absence of contact fromboth the contact detection units 1701 and 1702, the process returns tostep S2101.

In step S2103, the stimulus device driving unit 1705 outputs the drivingcontrol signal representing the first driving pattern to the stimuluspresentation units 1703-1 to 1703-M and the driving control signalrepresenting the second driving pattern to the stimulus presentationunits 1703-(M+1) to 1703-N. The first driving pattern and the seconddriving pattern can be either predetermined or generated in this step inaccordance with the human body contact state on the stimuluspresentation units 1703-1 to 1703-N estimated from the contact detectionresults received from the contact detection units 1701 and 1702. Thestimulus presentation units 1703-1 to 1703-N are driven based on thereceived driving control signals (driving patterns), respectively,thereby producing tactile stimuli which combine to express transferinformation. The process then returns to step S2101.

In step S2104, the stimulus device driving unit 1705 outputs the drivingcontrol signal representing the third driving pattern to the stimuluspresentation units 1703-1 to 1703-M. The third driving pattern can beeither predetermined or generated in this step in accordance with thehuman body contact state on the stimulus presentation units 1703-1 to1703-M estimated from the contact detection results received from thecontact detection units 1701 and 1702. The stimulus presentation units1703-1 to 1703-M are driven based on the received driving control signal(driving pattern), thereby producing tactile stimuli which combine toexpress transfer information. The process then returns to step S2101.

In step S2105, the stimulus device driving unit 1705 outputs the drivingcontrol signal representing the third driving pattern to the stimuluspresentation units 1703-(M+1) to 1703-N. The third driving pattern canbe either predetermined or generated in this step in accordance with thehuman body contact state on the stimulus presentation units 1703-(M+1)to 1703-N estimated from the contact detection results received from thecontact detection units 1701 and 1702. The stimulus presentation units1703-(M+1) to 1703-N are driven based on the received driving controlsignal (driving pattern), thereby producing tactile stimuli whichcombine to express transfer information. The process then returns tostep S2101.

By repeating the above-described processing, the information transferdevice 1700 can notify the user of transfer information via a tactilestimulus regardless of the user's way of holding the informationtransfer device.

Fourth Embodiment

An information transfer device according to this embodiment transfersinformation to a user via a tactile stimulus, as in the secondembodiment. In the information transfer device of this embodiment, eachof the contact detection units 1001 and 1002 described in the secondembodiment further includes a plurality of contact detection units(sub-contact detection units). That is, including a plurality of contactdetection units into, e.g., the contact detection unit 1001 enablesfiner (more correct) contact detection.

<Arrangement of Information Transfer Device 2200>

FIG. 22 is a block diagram showing an example of the functionalarrangement of the information transfer device 2200 according to thisembodiment. As shown in FIG. 22, the information transfer device 2200includes contact detection units 2201-1 to 2201-N, stimulus presentationunits 2203 and 2204, and a stimulus device driving unit 2205.

Each of the contact detection units 2201-1 to 2201-M is the same as thecontact detection unit 1001 described in the second embodiment and isarranged on or inside the information transfer device 2200 in apredetermined arrangement pattern. Each of the contact detection units2201-(M+1) to 2201-N is the same as the contact detection unit 1002described in the second embodiment and is arranged on or inside theinformation transfer device 2200 in a predetermined arrangement pattern.Each of the contact detection units 2201-1 to 2201-N outputs a signalrepresenting a detection result to the stimulus device driving unit2205.

The stimulus presentation units 2203 and 2204 are the same as thestimulus presentation units 1003 and 1004 of the second embodiment.

FIG. 23 is a view showing an example of the outer appearance of theinformation transfer device 2200. As shown in FIG. 23, the array of thecontact detection units 2201-1 to 2201-M is horizontally arranged alongthe upper side of a surface of the information transfer device 2200. Thestimulus presentation unit 2203 is arranged near them. On the otherhand, the array of the contact detection units 2201-(M+1) to 2201-N ishorizontally arranged along the lower side of the surface of theinformation transfer device 2200. The stimulus presentation unit 2204 isarranged near them. That is, the contact detection units 2201-1 to2201-N are divided into two groups, i.e., the group of the contactdetection units 2201-1 to 2201-M and the group of the contact detectionunits 2201-(M+1) to 2201-N. The number of divided groups need not alwaysbe two depending on the number of stimulus presentation units or thearrangement form of the contact detection units.

Based on detection result signals received from the contact detectionunits 2201-1 to 2201-N, the stimulus device driving unit 2205 supplies adriving pattern to each of the stimulus presentation units 2203 and2204. The driving pattern represents ON/OFF of driving or a time-ratechange of intensity.

The stimulus device driving unit 2205 refers to the detection resultsignals received from the contact detection units 2201-1 to 2201-N. Iffollowing <condition 1> is satisfied as a result of the reference, thestimulus device driving unit 2205 supplies a first driving pattern tothe stimulus presentation unit 2203 and a second driving pattern to thestimulus presentation unit 2204.

<Condition 1>

The stimulus device driving unit 2205 receives detection result signalsrepresenting presence of contact from a predetermined number or more ofcontact detection units out of the contact detection units 2201-1 to2201-M and detection result signals representing presence of contactfrom a predetermined number or more of contact detection units out ofthe contact detection units 2201-(M+1) to 2201-N.

Each driving pattern expresses transfer information by combining stimuliproduced upon driving.

The first driving pattern and the second driving pattern can either beconstant independently of the number (effective number) of contactdetection units which have output detection result signals of levelsequal to or higher than a threshold or change in accordance with theeffective number. For example, the first driving pattern or the seconddriving pattern may be a pattern having an amplitude proportional to theeffective number. Alternatively, the first driving pattern and thesecond driving pattern may be decided based on the combination of thecontact detection units which have output detection result signals oflevels equal to or higher than the threshold. For example, when acontact detection unit closer to the stimulus presentation unit 2203 or2204 outputs a detection result signal of level equal to or higher thanthe threshold, a driving pattern with a high intensity may be used asthe first driving pattern and the second driving pattern. For example,if the contact detection unit which has output a detection result signalof level equal to or higher than the threshold is registered in advanceas a contact detection unit of interest, it is possible to determinethat the user is gripping the information transfer device 2200 assupposed (or well). In this case, a driving pattern capable of notifyingthe user of transfer information in more detail may be used as the firstdriving pattern and the second driving pattern. If the contact detectionunit which has output a detection result signal of level equal to orhigher than the threshold is not that registered in advance as a contactdetection unit of interest, it is possible to determine that the user isgripping the information transfer device 2200 in a manner against thesupposition (or poorly). In this case, a driving pattern capable ofreliably notifying the user of at least an outline of transferinformation may be used as the first driving pattern and the seconddriving pattern.

If following <condition 2> is satisfied, the stimulus device drivingunit 2205 supplies a third driving pattern to the stimulus presentationunit 2203.

<Condition 2>

The stimulus device driving unit 2205 receives detection result signalsrepresenting presence of contact from a predetermined number or more ofcontact detection units out of the contact detection units 2201-1 to2201-M and detection result signals representing absence of contact froma predetermined number or more of contact detection units out of thecontact detection units 2201-(M+1) to 2201-N.

The third driving pattern expresses transfer information via a stimulusproduced upon driving. The third driving pattern can either be constantindependently of the number (effective number) of contact detectionunits which have output detection result signals of levels equal to orhigher than a threshold or change in accordance with the effectivenumber. For example, the third driving pattern may be a pattern havingan amplitude proportional to the effective number. Alternatively, thethird driving pattern may be decided based on the combination of thecontact detection units which have output detection result signals oflevels equal to or higher than the threshold. For example, when acontact detection unit closer to the stimulus presentation unit 2203outputs a detection result signal of level equal to or higher than thethreshold, a driving pattern with a high intensity may be used as thethird driving pattern.

As described above, providing contact detection units more than thestimulus presentation units to detect a more detailed contact statemakes it possible to notify the user of transfer information via astimulus corresponding to the contact state detected in more detail.

<Operation of Information Transfer Device 2200>

FIG. 24 is a flowchart of processing executed by the informationtransfer device 2200.

First, in step S2401, the stimulus device driving unit 2205 acquires adetection result signal transmitted from each of the contact detectionunits 2201-1 to 2201-N and representing presence/absence of contact or acontact strength.

In step S2402, the stimulus device driving unit 2205 refers to eachdetection result signal acquired in step S2401. The stimulus devicedriving unit 2205 determines whether each detection result signalrepresents presence of contact or absence of contact. This determinationis the same as in the first embodiment.

The processing branches based on the determination result.

When the stimulus device driving unit 2205 detects that condition 1 issatisfied, the process advances to step S2403. When the stimulus devicedriving unit 2205 detects that condition 2 is satisfied, the processadvances to step S2404. When the stimulus device driving unit 2205detects that following condition 3 is satisfied, the process advances tostep S2405.

<Condition 3>

The stimulus device driving unit 2205 receives detection result signalsrepresenting absence of contact from a predetermined number or more ofcontact detection units out of the contact detection units 2201-1 to2201-M and detection result signals representing presence of contactfrom a predetermined number or more of contact detection units out ofthe contact detection units 2201-(M+1) to 2201-N.

When the stimulus device driving unit 2205 detects that followingcondition 4 is satisfied, the process returns to step S2401.

<Condition 4>

The stimulus device driving unit 2205 receives detection result signalsrepresenting absence of contact from a predetermined number or more ofcontact detection units out of the contact detection units 2201-1 to2201-M and detection result signals representing absence of contact froma predetermined number or more of contact detection units out of thecontact detection units 2201-(M+1) to 2201-N.

In step S2403, the stimulus device driving unit 2205 outputs the drivingcontrol signal representing the first driving pattern to the stimuluspresentation units 2203 and the driving control signal representing thesecond driving pattern to the stimulus presentation unit 2204. The firstdriving pattern and the second driving pattern can be eitherpredetermined or generated in this step in accordance with the humanbody contact state on the stimulus presentation units 2203 and 2204estimated from the contact detection results received from the contactdetection units 2201-1 to 2201-N. The stimulus presentation units 2203and 2204 are driven based on the received driving control signals(driving patterns), respectively, thereby producing tactile stimuliwhich combine to express transfer information. The process then returnsto step S2401.

In step S2404, the stimulus device driving unit 2205 outputs the drivingcontrol signal representing the third driving pattern to the stimuluspresentation unit 2203. The stimulus presentation unit 2203 is drivenbased on the received driving control signal (driving pattern), therebyproducing a tactile stimulus to express transfer information. Theprocess then returns to step S2401.

In step S2405, the stimulus device driving unit 2205 outputs the drivingcontrol signal representing the third driving pattern to the stimuluspresentation unit 2204. The stimulus presentation unit 2204 is drivenbased on the received driving control signal (driving pattern), therebyproducing a tactile stimulus to express transfer information. Theprocess then returns to step S2401.

By repeating the above-described processing, the information transferdevice 2200 notifies the user of transfer information via a tactilestimulus regardless of the user's way of holding the informationtransfer device.

Fifth Embodiment

An information transfer device according to this embodiment transfersinformation not only via a perceptual stimulus as in the above-describedembodiments but also via another stimulus. Information transfer via avisual stimulus or an auditory stimulus assists information transfer viaa tactile stimulus. The information transfer device according to thisembodiment will be described below.

<Arrangement of Information Transfer Device 2500>

FIG. 25 is a block diagram showing an example of the functionalarrangement of the information transfer device 2500. As shown in FIG.25, the information transfer device 2500 includes contact detectionunits 2501 and 2502, stimulus presentation units 2503, 2504, and 2506,and a stimulus device driving unit 2505.

The contact detection units 2501 and 2502 are the same as the contactdetection units 1001 and 1002 of the second embodiment.

The stimulus presentation units 2503 and 2504 are the same as thestimulus presentation units 1003 and 1004 of the second embodiment.

The stimulus presentation unit 2506 (third stimulus presentation unit)is arranged on or inside the information transfer device 2500. Thestimulus presentation unit 2506 is driven in accordance with a drivingpattern generated by the stimulus device driving unit 2505 to present astimulus to a user. The stimulus presentation unit 2506 produces astimulus other than a tactile stimulus. Examples are a visual stimulusand an auditory stimulus. The user perceives a visual stimulus whenhe/she views the stimulus presentation unit. The stimulus presentationunit 2506 is formed from an LED, a light, a display, a speaker, or thelike. The driving pattern for a visual stimulus is an image pattern.That for an auditory stimulus is a voice pattern.

The operation of the stimulus device driving unit 2505 is basically thesame as that of the stimulus device driving unit 1005 of the secondembodiment. However, the stimulus device driving unit 2505 of the fifthembodiment supplies a driving pattern to the stimulus presentation unit2506 as well based on detection result signals received from the contactdetection units 2501 and 2502, unlike the stimulus device driving unit1005.

Expecting that information transfer via stimuli presented by thestimulus presentation units 2503 and 2504 will be insufficient, theinformation transfer device 2500 having the stimulus presentation unit2506 can assist the information transfer using a stimulus other than atactile stimulus. Assume that the stimulus device driving unit 2505receives a detection result signal representing presence of contact fromthe contact detection unit 2501 and a detection result signalrepresenting absence of contact from the contact detection unit 2502. Inthis case, the stimulus device driving unit 2505 outputs a drivingcontrol signal representing a third driving pattern to the stimuluspresentation unit 2503. The third driving pattern expresses transferinformation via a stimulus produced upon driving.

At this time, the stimulus device driving unit 2505 expects that thestimulus produced by only the stimulus presentation unit 2503 is unableto completely transfer information, and outputs a driving control signalrepresenting a fourth driving pattern to the stimulus presentation unit2506. The fourth driving pattern expresses transfer information via astimulus other than a tactile stimulus produced upon driving. Thepattern can be either the same as the third driving pattern or differentfrom it. For example, the stimulus presentation unit 2506 which presentsa visual stimulus emits light at the same timing as the tactile stimuluspresentation by the stimulus presentation unit 2503. Alternatively, thestimulus presentation unit 2506 which presents an auditory stimulusgenerates sound at the same timing as the tactile stimulus presentationby the stimulus presentation unit 2503. The stimulus presented by thestimulus presentation unit 2506 allows the user to receive the stimuliexpressing transfer information via a plurality of senses. It istherefore expected that the information can more reliably be transferredto the user.

As another example, the stimulus presentation unit 2506 which presents avisual stimulus may explicitly show transfer information by a text or animage. The stimulus presentation unit 2506 which presents an auditorystimulus may explicitly express transfer information by a voice. In thiscase, the user can associate a tactile stimulus with transferinformation expressed by it. It is therefore expected that the user canmore easily interpret a stimulus in subsequent information transfer.

<Operation of Information Transfer Device 2500>

FIG. 26 is a flowchart of processing executed by the informationtransfer device 2500.

First, in step S2601, the stimulus device driving unit 2505 acquires adetection result signal transmitted from each of the contact detectionunits 2501 and 2502 and representing presence/absence of contact or acontact strength.

In step S2602, the stimulus device driving unit 2505 refers to eachdetection result signal acquired in step S2601. The stimulus devicedriving unit 2505 determines whether each detection result signalrepresents presence of contact or absence of contact. This determinationis the same as in the first embodiment.

The processing branches based on the determination result.

When the stimulus device driving unit 2505 receives signals representingpresence of contact from both the contact detection units 2501 and 2502,the process advances to step S2603. When the stimulus device drivingunit 2505 receives a signal representing presence of contact from thecontact detection unit 2501 and a signal representing absence of contactfrom the contact detection unit 2502, the process advances to stepS2604. When the stimulus device driving unit 2505 receives a signalrepresenting absence of contact from the contact detection unit 2501 anda signal representing presence of contact from the contact detectionunit 2502, the process advances to step S2605. When the stimulus devicedriving unit 2505 receives signals representing absence of contact fromboth the contact detection units 2501 and 2502, the process advances tostep S2606.

In step S2603, the stimulus device driving unit 2505 outputs the drivingcontrol signal representing the first driving pattern and thatrepresenting the second driving pattern to the stimulus presentationunits 2503 and 2504, respectively. The stimulus presentation units 2503and 2504 are driven based on the received driving control signals,respectively. The first driving pattern and the second driving patterndescribed in the above embodiments may be used. The process then returnsto step S2601.

In step S2604, the stimulus device driving unit 2505 outputs the drivingcontrol signal representing the third driving pattern to the stimuluspresentation unit 2503. The stimulus presentation unit 2503 is drivenbased on the received driving control signal, thereby producing atactile stimulus which expresses transfer information. The third drivingpattern described in the above embodiments may be used. The process thenadvances to step S2606.

In step S2606, the stimulus device driving unit 2505 outputs the drivingcontrol signal representing the fourth driving pattern to the stimuluspresentation unit 2506. The stimulus presentation unit 2506 is drivenbased on the received driving control signal, thereby notifying the userof transfer information via a stimulus other than a tactile stimulus.Various kinds of fourth driving patterns are possible depending on thetype of a stimulus to be given such as a visual stimulus or an auditorystimulus. The process then returns to step S2601.

In step S2605, the stimulus device driving unit 2505 outputs the drivingcontrol signal representing the third driving pattern to the stimuluspresentation unit 2504. The stimulus presentation unit 2504 is drivenbased on the received driving control signal, thereby producing atactile stimulus which expresses transfer information. The process thenadvances to step S2606.

By repeating the above-described processing, the information transferdevice 2500 can notify the user of predetermined information via atactile stimulus regardless of the user's way of holding the informationtransfer device.

The condition under which the stimulus presentation unit 2506 is used isnot particularly limited, and the above description is a mere example.

The various stimulus patterns described in the above embodiments aremerely examples. Which stimulus pattern should be used to make the userperceive transfer information is not particularly limited. The aboveembodiments may be combined or used without several technical elementsas needed. That is, the aforementioned embodiments are based on thearrangements defined in the appended claims, and some of them have beendescribed with several additional technical elements as needed. Variousembodiments are available based on such arrangements. It is thereforepossible to implement a variety of embodiments except those describedabove.

As is apparent from the above-described embodiments, it is possible todecide an information expression method (i.e., stimulus presentationmethod) to transfer information in accordance with the way of contactwith the device. For example, information “right” is transferred using astimulus presentation unit located relatively on the right side out of aplurality of stimulus presentation units in contact, instead of alwaysusing a specific stimulus presentation unit or stimulus presentationpattern. Alternatively, information “right” is expressed by generating apattern that can be expressed only within the range of stimuluspresentation units in contact. This enables to correctly and efficientlytransfer information without the restriction “a body part needs to be assupposed in contact with a stimulus presentation unit”. That is, theproblem of the stimulus presentation techniques disclosed in patentreferences 1 and 2 and non-patent references 1 and 2, i.e., “correctinformation transfer may fail depending on how the user touches thedevice”, can be solved by selecting an information expression method inaccordance with the way of device touching.

<Modification>

In the above embodiments, the following units have been described ashardware.

Contact pattern recognition unit 102 and stimulus pattern generationunit 103 in FIG. 1

Stimulus device driving unit 1005 in FIG. 10

Stimulus device driving unit 1705 in FIG. 17

Stimulus device driving unit 2205 in FIG. 22

Stimulus device driving unit 2505 in FIG. 25

However, these units may be implemented as a computer program. Forexample, a computer program that causes the control unit (e.g., CPU orMPU) of the information transfer device to implement the functions ofthose units may be stored in the memory (e.g., RAM or ROM) of theinformation transfer device. In this case, the control unit canimplement the operations of the above-described units by executing thecomputer program stored in the memory.

Aspects of the present invention can also be realized by a computer of asystem or apparatus (or devices such as a CPU or MPU) that reads out andexecutes a program recorded on a memory device to perform the functionsof the above-described embodiment(s), and by a method, the steps ofwhich are performed by a computer of a system or apparatus by, forexample, reading out and executing a program recorded on a memory deviceto perform the functions of the above-described embodiment(s). For thispurpose, the program is provided to the computer for example via anetwork or from a recording medium of various types serving as thememory device (e.g., computer-readable medium).

While the present invention has been described with reference toexemplary embodiments, it is to be understood that the invention is notlimited to the disclosed exemplary embodiments. The scope of thefollowing claims is to be accorded the broadest interpretation so as toencompass all such modifications and equivalent structures andfunctions.

This application claims the benefit of Japanese Patent Application No.2008-256638 filed Oct. 1, 2008, which is hereby incorporated byreference herein in its entirety.

1. An information processing apparatus comprising: a plurality of sensor units which are attached to the information processing apparatus in a predetermined arrangement pattern, wherein each of the sensor units detects contact with a human body; a plurality of presentation units which are attached to the information processing apparatus in a predetermined arrangement pattern to present a tactile stimulus; a first specifying unit which specifies, out of said plurality of sensor units, a sensor unit that has detected contact; a second specifying unit which specifies, based on an arrangement distribution of the sensor unit specified by said first specifying unit and a type of information to be presented via a tactile stimulus, a presentation unit to be driven out of said plurality of presentation units; and a control unit which drives and controls the presentation unit specified by said second specifying unit.
 2. The apparatus according to claim 1, wherein said plurality of sensor units are provided on or inside the information processing apparatus.
 3. The apparatus according to claim 1, further comprising an additional plurality of sensor units including a sensor unit which detects one of direct/indirect contact with a user and direct/indirect contact with a physical object gripped by the user.
 4. The apparatus according to claim 1, wherein said plurality of presentation units are provided on or inside the information processing apparatus.
 5. The apparatus according to claim 1, wherein said second specifying unit specifies a set of presentation units respectively located adjacent to sensor units specified by said first specifying unit, and specifies, out of the presentation units included in the specified set, a set of presentation units to be used to generate stimuli to express information to be presented to a user as a target of driving and control of said control unit.
 6. A computer-readable storage medium storing a computer program which causes a computer to function as units included in an information processing apparatus of claim
 1. 7. An information processing apparatus comprising: a plurality of sensor units which are attached to the information processing apparatus in a predetermined arrangement pattern, wherein each of the sensor units detects contact with a human body; a plurality of presentation units which are attached to the information processing apparatus in a predetermined arrangement pattern to present a tactile stimulus; a first specifying unit which specifies, out of said plurality of sensor units, a sensor unit that has detected contact; a second specifying unit which specifies, out of said plurality of presentation units, a presentation unit corresponding to the sensor unit specified by said first specifying unit; and a control unit which drives and controls the presentation unit specified by said second specifying unit to generate a preset stimulus pattern to express information to be presented to a user.
 8. The apparatus according to claim 7, wherein each of said plurality of sensor units and a corresponding one of said plurality of presentation units make a pair, and said second specifying unit specifies a presentation unit paired with the sensor unit specified by said first specifying unit.
 9. The apparatus according to claim 7, wherein said plurality of presentation units are divided into a plurality of groups, each group and a corresponding one of said plurality of sensor units make a pair, and said second specifying unit specifies a presentation unit included in a group paired with the sensor unit specified by said first specifying unit.
 10. The apparatus according to claim 7, wherein said plurality of sensor units are divided into a plurality of groups, each group and a corresponding one of said plurality of presentation units make a pair, and said second specifying unit specifies a presentation unit paired with the sensor unit specified by said first specifying unit.
 11. The apparatus according to claim 7, further comprising a stimulus presentation unit to present a stimulus other than the tactile stimulus, wherein if said first specifying unit has been unable to specify the sensor unit, said control unit drives and controls said stimulus presentation unit.
 12. The apparatus according to claim 11, wherein said stimulus presentation unit is a unit to present at least a visual stimulus and an auditory stimulus.
 13. The apparatus according to claim 7, wherein said control unit uses the stimulus pattern corresponding to a combination of the sensor units specified by said first specifying unit.
 14. An information processing method performed by an information processing apparatus including: a plurality of sensor units which are attached to the information processing apparatus in a predetermined arrangement pattern, wherein each of the sensor units detects contact with a human body; and a plurality of presentation units which are attached to the information processing apparatus in a predetermined arrangement pattern to present a tactile stimulus, the method comprising: a first specifying step of specifying, out of the plurality of sensor units, a sensor unit that has detected contact; a second specifying step of specifying, based on an arrangement distribution of the sensor unit specified in the first specifying step and a type of information to be presented via a tactile stimulus, a presentation unit to be driven out of the plurality of presentation units; and a control step of driving and controlling the presentation unit specified in the second specifying step.
 15. An information processing method performed by an information processing apparatus including: a plurality of sensor units which are attached to the information processing apparatus in a predetermined arrangement pattern, wherein each of the sensor units detects contact with a human body; and a plurality of presentation units which are attached to the information processing apparatus in a predetermined arrangement pattern to present a tactile stimulus, the method comprising: a first specifying step of specifying, out of the plurality of sensor units, a sensor unit that has detected contact; a second specifying step of specifying, out of the plurality of presentation units, a presentation unit corresponding to the sensor unit specified in the first specifying step; and a control step of driving and controlling the presentation unit specified in the second specifying step to generate a preset stimulus pattern to express information to be presented to a user.
 16. An information processing apparatus for transferring predetermined information via a tactile stimulus, comprising: a first contact detection unit which detects contact with a human body; a second contact detection unit which detects contact with a human body; a first stimulus presentation unit; a second stimulus presentation unit; and a stimulus device driving unit which drives said first stimulus presentation unit and said second stimulus presentation unit, wherein when said first contact detection unit and said second contact detection unit have detected contact, said stimulus device driving unit drives said first stimulus presentation unit based on a first driving pattern that expresses the predetermined information and said second stimulus presentation unit based on a second driving pattern that expresses the predetermined information, and when only said first contact detection unit has detected contact, said stimulus device driving unit drives said first stimulus presentation unit based on a third driving pattern that expresses the predetermined information.
 17. The apparatus according to claim 16, wherein said first stimulus presentation unit includes a plurality of sub-stimulus presentation units.
 18. The apparatus according to claim 16, wherein said second stimulus presentation unit includes a plurality of sub-stimulus presentation units.
 19. The apparatus according to claim 16, wherein when only said first contact detection unit has detected contact, said stimulus device driving unit drives said second stimulus presentation unit based on the third driving pattern.
 20. The apparatus according to claim 16, wherein when only said first contact detection unit has detected contact, said stimulus device driving unit drives said second stimulus presentation unit based on a driving pattern that expresses the predetermined information.
 21. The apparatus according to claim 16, wherein said first contact detection unit includes a plurality of sub-contact detection units.
 22. The apparatus according to claim 16, wherein said second contact detection unit includes a plurality of sub-contact detection units.
 23. The apparatus according to claim 16, further comprising a third stimulus presentation unit, wherein said stimulus device driving unit drives said third stimulus presentation unit based on a fourth driving pattern that expresses the predetermined information, thereby causing said third stimulus presentation unit to present a stimulus for a sense different from that of said first stimulus presentation unit and said second stimulus presentation unit.
 24. The apparatus according to claim 23, wherein when one or both of said first contact detection unit and said second contact detection unit have detected no contact, said stimulus device driving unit drives said third stimulus presentation unit.
 25. An information processing method performed by an information processing apparatus for transferring predetermined information via a tactile stimulus, the information processing apparatus including: a first contact detection unit which detects contact with a human body; a second contact detection unit which detects contact with a human body; a first stimulus presentation unit; a second stimulus presentation unit; and a stimulus device driving unit which drives the first stimulus presentation unit and the second stimulus presentation unit, the method comprising: when the first contact detection unit and the second contact detection unit have detected contact, causing the stimulus device driving unit to drive the first stimulus presentation unit based on a first driving pattern that expresses the predetermined information and the second stimulus presentation unit based on a second driving pattern that expresses the predetermined information, and when only the first contact detection unit has detected contact, causing the stimulus device driving unit to drive the first stimulus presentation unit based on a third driving pattern that expresses the predetermined information. 